Papers with annotation protocol
Angry or Sad ? Emotion Annotation for Extremist Content Characterisation (2022.lrec-1)
Copied to clipboard
| Challenge: | Social platforms play an increasingly important role in the propagation of extremist ideas. |
| Approach: | They propose to use a linguistic annotation scheme to characterize extremist content in French . they validate the scheme and test its ability to capture various aspects of emotions . |
| Outcome: | The proposed method combines sociological and linguistic knowledge to characterize extremist content in French. |
SLäNDa: An Annotated Corpus of Narrative and Dialogue in Swedish Literary Fiction (2020.lrec-1)
Copied to clipboard
| Challenge: | a new corpus of literary fiction has been annotated for cited materials with a focus on dialogue. |
| Approach: | They propose to annotate a new corpus of Swedish literary fiction for cited materials with a focus on dialogue. |
| Outcome: | The proposed corpus can be used to train and analyze models for different types of analysis of literary narrative and speech. |
MaXM: Towards Multilingual Visual Question Answering (2023.findings-emnlp)
Copied to clipboard
Soravit Changpinyo, Linting Xue, Michal Yarom, Ashish Thapliyal, Idan Szpektor, Julien Amelot, Xi Chen, Radu Soricut
| Challenge: | Visual Question Answering (VQA) has been studied in the English language, but in other languages it would require a considerable amount of resources. |
| Approach: | They propose scalable solutions to multilingual visual question answering using an English language framework and an annotation protocol. |
| Outcome: | The proposed framework reduces human annotation efforts and creates a test-only VQA benchmark in 7 languages. |
A Multimodal Educational Corpus of Oral Courses: Annotation, Analysis and Case Study (2020.lrec-1)
Copied to clipboard
Salima Mdhaffar, Yannick Estève, Antoine Laurent, Nicolas Hernandez, Richard Dufour, Delphine Charlet, Geraldine Damnati, Solen Quiniou, Nathalie Camelin
| Challenge: | a corpus of spontaneous speech is being developed for educational use . the dataset will be freely available to the research community . |
| Approach: | They propose to use a French speech educational corpus to explore synchronous speech transcription and application in teaching situations. |
| Outcome: | The proposed corpus includes 10 hours of lectures, manually transcribed and segmented . the dataset will be freely available to the research community . |
Increasing Argument Annotation Reproducibility by Using Inter-annotator Agreement to Improve Guidelines (L18-1)
Copied to clipboard
| Challenge: | Argument Mining systems require large amounts of data to characterize phenomena and find patterns that can be exploited by an automatic analyzer. |
| Approach: | They propose to exploit inter-annotator agreement measures to improve Argument annotation guidelines. |
| Outcome: | The proposed method improves Argument annotation guidelines by exploiting inter-annotator agreement measures. |